Merging of the Senses

When we are constantly and simultaneously bombarded with various types of sensory inputs, how do we make decisions or motor outputs to deal with the world in a meaningful manner? This is a central issue in multisensory integration. One example of such type of processing is eating, as placing food in one's mouth provides taste, olfactory and somatosensory (texture, temperature) information (Verhagen and Engelen, 2006, Simon et al., 2006). Indeed, virtually all combinations of the senses are multimodal (Verhagen and Engelen, 2006). Whatever the combination of modalities, information from widely separated areas is rapidly integrated to give a motor response. In the case of taste the response to swallow or reject is yielded. One possibility that our brains have evolved to deal with multisensory stimuli could be due to the combined response reveals more about the nature of the external event. Our grand challenge is to know how information from different modalities that originally seem to be processed as unimodal events is combined during development to produce a coherent percept. This is known as the " binding problem " (Singer, 2001) and is important to all multisensory processing. Many issues regarding multisensory processing are found in a very recent and excellent review by Stein and Stanford (Stein and Stranford, 2008), and given the space limitations , I will not repeat them but rather give my opinion as to what is missing and what experiments would lead to a better understanding. It has been proposed that the entire neocortex is multisensory (Ghazanfar and Schroeder, 2006) and, although there has been some controversy about this proposal, it would be useful to have an atlas of the multisensory specificity of all subcortical and cortical areas. In electrophysiological studies of multisensory integration most recordings have been from single units, and confined to a single area. No doubt these recordings have lead to many advances and the formulation of rules that govern multisensory processing (e.g. superadditivity (Stein and Stranford, 2008), but it would be more informative if ensembles of neurons could be recorded in different areas while animals are being tested. This could be done either with implanted arrays of electrodes or with optical imaging (Nicolelis, 2007; Gradinaru, 2007). In this manner we will learn how different neurons in the same and different areas interact (synchronously or asynchronously) at Sidney A. Simon received his PhD in 1973 in Materials Science from Northwestern University. He then …